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Abstract 

This paper exhibits quadratic products of linear combinations of observables which identify the co- 
variance structure underlying the univariate locally linear time series dynamic linear model. The first- 
and second-order moments for the joint distribution over these observables are given, allowing Bayes 
linear learning for the underlying covariance structure for the time series model. An example is given 
which illustrates the methodology and highlights the practical implications of the theory. 

Keywords: BAYES LINEAR METHODS; DYNAMIC LINEAR MODELS; EXCHANGEABILITY; IDEN- 
TIFIABILITY; VARIANCE ESTIMATION. 

1 Introduction 

In , new methodology is developed for the revision of covariance structures underlying two-step invertible 
dynamic linear models (DLMs). Two-step invertible DLMs are essentially models without a trend component. 
Here, the locally linear DLM will be discussed, which does have a trend component, and so is not two- 
step invertible. Interest will be focussed on univariate DLMs, since it is simpler to explain the theory 
in the univariate context. However, a full covariance matrix approach may be taken to the multivariate 
counterpart, thus generalising the work in It will be shown how one may learn about the three different 
kinds of variance associated with the locally linear dynamic linear model, using partial prior specification 
for certain aspects of the model. The theory will be applied to the modelling of sales of a particular product 
from a wholesale depot, and the importance of good estimation of all of the variance components will be 
demonstrated in the context of this example. 

2 Variance modelling 
2.1 The linear model 

First consider the model for the time series {Vi, V2, . . .}. 

Xt = Mt + Yu, Vt>l (1) 
Mt = Mt-i+Nt+Y2t, Vt>2 (2) 
Nt = Vt_i+V3t, yt>2 (3) 

where beliefs about Ali and Ni are specified a priori, and the collection of quantities {V^fclj = 1, 2, 3, k > 1} 
have expectation zero, and are mutually uncorrelated. Further, Ya,T(Yjk) = Vj does not depend on k for 
j = 1,2,3, k > 1. Using the terminology of j^, this is a second-order description of the univariate locally 
linear time series DLM. Here interest focusses on Bayes linear methods for learning about the covariance 
structure underlying this model. Explicitly, the desire is to make inferences about the variances of Yu, Y2t 
and Yat, in order that we might revise specifications for ui, V2 and v^. 
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2.2 The quadratic model 

Form the unobservable vector time series {Zi,Z2, . . .}, where Zt — {Y^^,Y2f,Y^^)'^ , Vt > 1. This time series 
is judged to be a second-order exchangeable sequence (that is, mean, variance and covariance specifications 
for the sequence remain invariant under an arbitrary permutation of the sequence), as described in j^]. 
Using the second-order exchangeabihty representation theorem we may decompose the vectors, Zj in the 
foUowing way. 

Zt=Y + St, Vt>l (4) 

where E(St) 0, Cov(V, St) = 0, Vi and Cov(Ss, St) = Vs ^ t. The additional assumptions, Cov(V^,, Vj) 
0, yi + 3 and CoY{Su,S,t) = Vi ^ j,Vf, where V = {Vi,V2,V3)^ and S* = (5it, ^st, ^3t), Vf, are made. 
Note that the components of V represent the underlying variances for Yit, Y2t and Ist, and in particular, 
that E(V) — (Var(Yi(), Var(y2t)j Var(F3t))"''. Revised beliefs about V will lead to revised specifications for 
vi, V2 and V3. Next, observables are constructed which are predictive for V. 



3 State independent observables 
3.1 Linear observables 

First construct the one-step differenced time series, {X2,X^, . . .}, where 

- Xt-Xt-i (5) 

= Aft + r2t+Yit-ri(t-i), Vt>2 (6) 

Next construct the one-, two-, and three-step differences of the differenced series, {X^^^'' , x'l^^ ,■■■}, {X^^'' , ^5^'' , . 
and where 

= Y3t + Y2t~Y2^t^,)+Yn-2Y^t-i)+Y^t^2), Vt > 3 (7) 

= Yit + i"3(t-l) + Y2t - ^2(4-2) + Yu ~ ri(t_i) - yi(t_2) + ^(4-3), V< > 4 (8) 
-^(3) _ y' y' 

= Yst + ^3(4-1) + ^3(t-2) + Y2t - >2(t-3) + Yit - Y^t-l) - Ynt-3) + ^l(t-4), 

Vi > 5 (9) 

Note that these observable series only involve the error structure. Also note that the\X^^\ xj^^\ . . .} series 
is (second-order) 3-step exchangeable, as defined in and discussed more fully in ]3riefly, a collection 
of random quantities is (second-order) n-step exchangeable if the expectation and covariance structure over 
them is invariant under a reflection or arbitrary translation of the collection, and if the covariance between 
any two members of the collection is fixed provided only that they are a distance of at least n apart. Note 
similarly that the {X^^\ X^'^\ . . .} series is 4-step exchangeable and that the {X^^\ ^tt^ ■ ■ ■} series is 5-step 
exchangeable. 



3.2 Quadratic observables 

/'-|^'j2 fl)2 (2)'^ f2l 2 ^3)2 f3l2 

Form the series of the squares of the linear series, {X^ , X^ ,■■■}, {^4 , ^5 , . . .} and {X^ , Xg ,■■■}■ 
Note that due to assumptions of (second-order) exchangeability for the quadratic residuals, these series have 
the same n-step exchangeability properties as the linear series they are constructed from. Consequently, the 
(second-order) n-step exchangeability representation theorem tells us that the series identify the Cauchy 
limit of the partial arithmetic means. A random quantity is identified by a collection of observables if as 
much uncertainty as is desired may be resolved by observing an increasing number of the observables. 

Lemma 1 The foUowing identification results hold. 
• {Xt^^^V* > 3} identify 6Vi + 2V2 + V3 
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{Xp^ |Vt > 4} identify Wi + 2V2 + 2V3 
{Xf > 5} identify Wi + 2V2 + W3 



Proof 

Using 



and (0), the collection {X^'^^~\\ft > 3} identifies 



1^2 1 ^ 

t=3 t=3 



1 ^ 



^ii;t-2)) 



t=3 



= + ^2 + ^1 + m + V2 + V1 
= 6V1 + 2V2 + V3 

Using (||) and (|^), the other results follow similarly. 

In fact, {X^^^'^l'it >n + 2} identifies Wi + 2V2 + nVs, Vn > 2. Note also that 

' 1/2 -1 1/2 

-1 7/2 -2 

^ -I I 

and so Lemma |l| inverts to give 

Theorem 1 The following identification results hold. 




(1) 



X 



(2Y 



|Vt > 5} identify Vi 



- 2Xf > 5} identify V2 



{-Xf + Xf^^\it > 5} identify V3 



Proof 

Clear from Lemma and 



(10) 

(11) 

(12) 
(13) 



(14) 



Of course, the partial arithmetic means of these collections may be used as frequentist unbiased estimators 
of the underlying variances (though they would not necessarily have optimum variance properties). Here, 
the quadratic observables will be used in order to allow Bayes linear updating of beliefs for the underlying 



variances. 



4 Bayes linear methods 

A Bayes linear approach is taken to subjective statistical inference, making expectation (rather than proba- 
bility) primitive. An overview of the methodology is given in Q. The emphasis of this paper is on learning 
about underlying means; however, the foundations of the theory are quite general, and are outlined in the 
context of second-order exchangeability in Q , and discussed for more general situations in |^ . Bayes lin- 
ear methods may be used in order to learn about any quantities of interest, provided only that a mean 
and variance specification is made for all relevant quantities, and a specification for the covariance between 
all pairs of quantities is made. No distributional assumptions are necessary. There are many interpretive 
and diagnostic features of the Bayes linear methodology. These are discussed with reference to [B/D] (the 
computer language used for the analysis of the example given in this paper) in j^. 
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5 Covariance structure over the quadratic observables 



In order to carry out Bayes linear updating of the underlying variances, the covariances over and between 
the underlying variables and the predictive observables are required. They are given as follows: 

Lemma 2 



Cov{Vi,Xl ' ) 


= 6Var(Fi), 


> 3 


(15) 


Cov(Vi,xf)^) 


= 4Var(t/i), 




(16) 


Cov(t/i,xP^) 


= 4Var(t/i), 




(17) 


Cov(F2,xf'^) 


= 2Var(t/2), 


yt>3 


(18) 


Cov(V2,xf' ^) 


= 2Var(V^2), 


> 4 


(19) 


Cov(T/2,xf^^) 


= 2Var(F2), 


> 5 


(20) 


Cov(V3,xf^^) 


= lVar(t/3), 


> 3 


(21) 


Cov(T/3,xf' ^) 


= 2Var(F3), 


> 4 


(22) 


Cov(V3,xf^^) 


= 3Var(V^3), 


Vi > 5 


(23) 



Proof 

These are a trivial consequence of Lemma |l] and the n-step exchangeability representation theorem. □ 

The covariances between the quadratic observables themselves are rather complex, and are given in the 
appendix. 

6 Bayes linear adjustment for the variances 

Theorem]^ shows that Bayes linear fitting of the underlying variances, Vi, V2, and V3 on sufficiently many 
quadratic observables will eventually resolve all uncertainty about these quantities. Of course, in practice one 
will have only a finite number of observations, N, with which to update beliefs about the underlying variance 
structure. The adjusted expectation for V, E£)(V) given the three finite series of quadratic observables, 
{X^t^^\3 <t<N}, {Xf ^|4 <t<N} and {xf ^|5 <t<N} takes the form 

Ed{V) =E(V) + Cov(V,D)[Var(D)]1'[D-E(D)] (24) 

where D is the (3A^ — 9)-dimensional vector 

and [Var(D)]t denotes the Moore- Penrose generalised inverse of Var(D). All necessary covariances are given 
in the previous section and the appendix. Note that there is nothing particularly special about the choice 
of D other than the fact that it is one of the smallest choices of D which will lead to identification of the 
underlying variance structure. It could be enlarged by introducing terms of the form Xf etc. This would 
lead to a richer projection space, and hence more efficient estimates. However, one would have to compute 
the covariance structure over the extra observables, and this exercise would quickly become computationally 
unattractive. 

7 Example 

The theory developed thus far will now be applied to a genuine example arising from research into the 
forecasting of competitive retail markets. Figure |] shows a time series for the case sales of the leading brand 
of cola from a particular wholesale depot in England for the first 200 days of 1995. It is assumed that these 
sales figures, {^t|l < t < 200}, follow a second-order locally linear time-series DLM, and so the 3-, 4- and 
5-step exchangeable sets of quantities, {X^^^\3 < t < 200}, {xf |4 < t < 200} and {xf ^|5 < t < 200} are 
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formed, as described in Section 3.1, and these are shown in Figure ^. According to our model, these sets 
of quantities are mean zero n-step exchangeable, and so obvious evidence of an underlying mean away from 
zero, or evidence of long-range dependencies would be evidence against the model. There does not appear 
to be any obvious discrepancies. Note that short-range dependencies, and dependencies between the series 
are to be expected. 
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Figure 1: Plot showing the time series of sales for the example 
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Figure 2: Plot showing the mean zero linear combinations 
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Next, the quadratic observables ixj^^~\3 < t < 200}, {X^'^>~\4: < t < 200} and {X^t''>~\5 < t < 200} 



(2)^ 



.(3)^ 



are formed, as described in Section 3.2, and these are shown in Figure ^ Again, due to assumptions about 
the exchangeabiHty of the quadratic residuals, these series are each n-step exchangeable, and so obvious 
long-range dependencies would be evidence against our model. Fortunately, none are apparent, although 
short range dependencies, and dependencies between series are particularly clear in this figure. 
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Figure 3: Plot showing quadratic observables 

A priori belief specifications are required before analysis can take place. The specifications required for 
a basic linear analysis of this problem were made as follows. 

E(Afi) = 20, Var(Mi) = 20^ E(iVi) = 0, Var(iVi) = 3^ (26) 
E(T/i) =Var(Yit) = 5^, EiV^) =Ysir {Y^t) = 0.2^ , ^{¥3) ^ Yar (Yst) = O.l^, (27) 

The above specifications are also precisely those required for a fully Bayesian approach to the analysis of 
the locally linear time series DLM, together with some distributional assumptions, as described in The 
additional specifications required for a quadratic analysis are given below. 



Var(Fi) = Var(V2) = l^ Var(y3) = 0.2^ 
Var(^u) = 2(5*), Var(52t) = 2(0.2*), Var(5; 



3t) 



2(0.1"), yt 



(28) 
(29) 



Note that in this example, for simplicity, the variance specifications for the Su have been made to be 
consistent with a fit for the distribution of Y^, given their underlying mean. Such fitting is discussed in 
the more general multivariate context in Note however, that such fitting is not required, and that in any 
case, assignment of the fourth moments in this way is a much weaker assumption than that of full normality 
of the Yit . 

Clearly, the additional specification burden required in order to carry out variance learning is quite small. 
Specification of six additional numbers (three, if one is prepared to fit the Var(S'i4)) is all that is required. 
Note also that since we take a Bayes linear approach, adjustments reduce to the solving of matrix equations, 
and so the computational requirements are not great. 

The Bayes linear computing package, [B/ D], was used to analyse the problem. "Elements" corresponding 
to the linear and quadratic terms were "built" , and expectations and covariances were assigned appropriately, 
using output from computer algebra systems where necessary. The computer algebra systems were used for 
numerical substitution of beliefs into the covariance formulae given in the appendix, as well as for the algebraic 
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derivation of the formulae themselves. Beliefs about Vi, V2 and V3 were then adjusted using the quadratic 
observables formed from the first 200 observations from the series. The sequence of adjusted expectations, 
together with corresponding two-standard deviation credibility bounds for the variance components are 
shown in Figure ^. Notice that beliefs about all of the variances have been revised upwards. In particular, 
beliefs about the magnitude of Vi have been revised upwards quite sharply, relative to prior uncertainty. 
The magnitude of the revisions should be regarded as a diagnostic warning for the high-order variance 
specification, since the eventual adjusted expectation lies some way outside the a priori credibility bounds. 
The adjustments for the variances were as follows. 

Ez3(Fi) = 171, Ed{V2)=4.75, (1/3) = 0.36 (30) 

We shall see the implications of these revisions for first order adjustments, later. These adjustment sequences 
may be compared with natural unbiased sample estimates for the variance components, as shown in Figure 
^. These estimates can be seen to be unstable, due to the fact that the variance of these estimates is very 
large, even with 200 observations. 
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Figure 4: Variance component adjustments 

We may now consider the linear forecasting problem, and compare the forecasts of that model using 
the original, and adjusted variance specifications. Figure ^ shows the first order adjustments, together 
with a one-step ahead predictive two-standard deviation credibility interval, using the original variance 
specifications. It appears that the specification for Var(Yit) may be too small, since considerably more than 
5% of observations lie outside the credibility interval. Figure ^ shows the same, using the adjusted variances. 
The increased specification for Var(Yit) leads to wider credibility intervals, which can be clearly seen to 
match better with the forecast performance of the model. Notice also that the increased estimate for V2 
allows the mean parameter, Mt, to adapt more quickly to fluctuations in the data. 

8 Conclusions 

Appropriate variance specifications are crucial to the performance of dynamic linear models. Even a carefully 
chosen, and wholly appropriate model will perform very poorly if the variance specifications used are wrong. 
This fact has long been appreciated, and in methods for the updating of the top-level variance (Vi in 
this paper) are discussed. However, such methods remain the state of the art, and yet, not all uncertainty 
for the top-level variance is resolved, and no methods are given for data-driven learning for other variance 
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Figure 5: Unbiased sample estimates for the variance components 
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Figure 7: First order adjustments using revised variances 

components in the modeL Appropriate specifications for other variance components are just as important, 
and can have just as much effect on the performance of the model (especially for mean-dominated series, 
such as many financial time series). In the example given in this paper, learning that V2 was bigger than 
thought allowed the series parameters to adapt more quickly to the data. Such data-driven learning for the 
parameter variances is not possible using existing DLM methodology. Further, it is hard to see how the 
methodology might be adapted to allow such learning. Here, methods are given for learning about all of 
the variance components for a locally linear time series model, using limited partial prior specifications for 
the variance components, thus providing a subjective Bayesian, computationally tractable solution to the 
problem. 
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Appendix 

The covariances between the quadratic observables themselves are rather complex, and were calculated using 
computer algebra packages in order to ensure accuracy. 

Lemma 3 The covariance structure over the terms is given by the following relations. 

Cov(x('>^ = Var(S3t) + 2Va.r{S2t) + 18Var(5it) + Var(y3) + 8Var(l/2) 

+72Var(\/i) + ?,¥.{Vz)^(V2) + 24E(V3)E(yi) + A'E.{V2f 
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+48E(F2)E(Vi) + 36E(yl)^ Vt > 3 (31) 

Cov(Xt''>^ = Var(S2t) + 8Var(Su) + Var(V3) + 4Var(F2) + 52Var(l/i) 

+16E(y2)E(Fi) + 16E(Vi)^ Vt > 4 (32) 

Cov(xf'^X^^i'/) = Var(S'u)+Var(V3)+4Var(y2)+36Var(Vi), Vt > 5 (33) 

Cov(XJ^'^^x|i'/) = Var(V3) +4Var(y2) +36Var(Vi), Vs>3,Vt>s + 3 (34) 

(2)2 

Lemma 4 T/ie covariance structure over the terms is given by the following relations. 

Cov(xf ^^ Xf '^) = 2(Var(5'3t) + Var(5'2t) + 2Var(Sit) + 4Var(V3) + 4Var(l/2) 

+20Var(yi) + 2E(V3)'' + 8E{Vi)E{V2) + 16E(V'3)E(V1) + 2E(y2)' 
+16E(F2)E(Fi) + 12E(Vi)^), Vt > 4 (35) 

Cov(xf '^ \') = Var(53t) + 3Var(5u) + 4Var(V^^) + 4Var(l/2) + 12Var(yi) 

-4E(y3)E(Vi) - AEiVif, Vt > 5 (36) 

Cov(xf ^^ X|!.^/) = Var(S'2t) + 2Var(S'it) + 4Var(y3) + 4Var(V2) + 20Var(yi) 

+8E(V2)E(Vi) + 4E(Vl)^ Vt > 6 (37) 

Cov(xf '^ X^^!.'3^) = Var(S'it) + 4Var(V3) + 4Var(l/2) + 16Var(Fi), Vt > 7 (38) 



Cov(Xf ^ , Xll>^ ) = 4(Var(V'3) + Var(V2) + 4Var(Vi)), Vs > 4, Vt > s + 4 (39) 



.(2)2 ^(2) 2 

(3)2 



Lemma 5 The covariance structure over the ' terms is given by the following relations. 

Cov(xf '^ '^) = 3Var(S3t) + 2Var(S2t) + 4Var(5u) + 21Var(y(3)) + 8Var(y2) 

+40Var(yi) + 12E(V^^)2 + 24E(V^^)E(y2) + 48E(V'3)E(Vi) + 4E(F2)^ 
+32E(y2)E(yi) + 24E(Vl)^ > 5 (40) 

Cov(xf ^t-i^) = 2Var(S'3t) + 2Var(S'it) + 13Var(V3) + 4Var(y2) + 20Var(Fi) 

+4E(V3)^ - 16E(V'3)E(Fi) + 4E(Vl)^ Vt > 6 (41) 

Cov(xf ^^ Xj^!.'/) = Var(53t) + Var(5it) + 9Var(y3) + 4Var(V^2) + 16Var(Vi) 

+4E(F3)E(Vi), Vt > 7 (42) 

Cov(xf )^ X^^!.'3^) = Var(S'2«) + 2Var(5it) + 9Var(V3) + 4Var(V'2) + 20Var(Vi) 

+8E(V'2)E(Vl)+4E(^/l)^ Vt>8 (43) 

Cov(xf'^X^<!.^/) = Var(5'it) +9Var(y3) +4Var(V2) + 16Var(yi), Vt > 9 (44) 

Cov(xf' ^ X('!.^/) = 9Var(V3) + 4Var(V2) + 16Var(Fi), Vs > 5, Vt > s + 5 (45) 

Lemma 6 The covariance structure between the X^ and X^ terms is given by the following relations. 

Cov(xf)^XJ^+)/) = 2(Var(V3) + 2Var(y2) + 12Var(Vi)), Vt > 3,Vs > 4 (46) 

Cov(xf ^^Xt'^'3^) = Var(5'it) + 2Var(V3) +4Var(V2) + 24Var(Vi), Vt > 3 (47) 
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Cov(X,(') ,^t+2 ) = Var(5'2t) + 5Var(Sit) + 2Var(\/3)+4Var(l/2) + 32Var(Vi) 
+12E(F2)E(Fi) + 8E{Vif, \/t>3 

Cov(xf )^ X,'^^'') = Var(53t) + VarC&t) + 6Ya.r{Su) + 2Var(V3) + 4Var(y2) + 20Var(Vi) 
+4E(V3)E(V2) + 8E(y3)E(Vi) + 8E(V2)E(Vi) - 4E{Vif, Vt > 3 

Cov(xi''^ Xf = Var(S3t) + Var(520 + 6Var(5'it) + 2Var(T/3) + 4Var(V2) + 20Var(l/i) 
+4E(T/3)E(T/2) + 8E(V3)E(l/i) + 8E(1/2)E(K) - 4E(Vl)^ > 4 

Cov(Xt'^^^ ^t-i^) = Var(S20 + 5Var(5if ) + 2Var(V3) + 4Var(y2) + 32Var(Vi) 
+12E(l/2)E(l/i) + 8E(Vi)^ Vt > 5 

Cov(xf'^XJ<!^2^) = Var(S'it) + 2Var(V3) +4Var(l/2) + 24Var(yi), Vi > 6 

CoY{xi^^'^,xl%^) = 2(Var(V3) + 2Var(y2) + 12Var(yi)), Vs>3,Vt>s + 4 

The covariance structure between the XI and XI terms is given by the following relations 
Cov(xi^'^Xt^+'/) = 3Var(V3) +4Var(y2) +24Var(Vi), Vs>5,Vt>3 

Cov(X,'''^Xt'^'/) = Var(S'it) + 3Var(l/3) +4Var(F2) +24Var(Vl), > 3 

Cov(xf '^ Xj^^^a^) = Var(S2t) + 5Var(5'it) + 3Var(V3) + 4Var(V2) + 32Var(yi) 
+12E(V2)E(Vi) + 8E(yi)^ Vt > 3 

Cov(X,'''', X,'+'/) = Var(5'3t) + Var(S2t) + 5Var(Su) + 3Var(V3) + 4Var(l/2) 
+32Var(Vi) + 4E(V'3)E(y2) + 12E(V3)E(l^(l)) 
+12E(V2)E(Vi) + 8E(Vl)^ Vt > 3 

Coy{xI''>\xI^^^') = Var(S'3t) + 2Var(SiO + 3Var(V3) + 4Var(l/2) + 28Var(l/i) 
-8E(l/3)E(l/i) + 4E(^/l)^ Vt > 4 

Cov(X('')^ Xf = Var(53t) + Var(S20 + 5Var(SiO + 3Var(V3) + 4Var(V2) 
+32Var(T/i) +4E(V3)E(V2) + 12E(V3)E(Fi) 
+12E(l/2)E(Fi) + 8E{Vif, Vt > 5 

Cov(xf )^ ^t-\^) = Var(5'2t) + 5Va.r{Su) + 3Var(V3) + 4Var(V2) + 32Var(yi) 
+12E(V2)E(V'i) + 8E{Vif, Vt > 6 

Cov(Xt'''^X,^!'/) = Var(5'if) + 3Var(F3) +4Var(l/2) + 24Var(l/i), Vt > 7 

Cov{X^^^'^,X^%^) = 3Var(V3) +4Var(V2) +24Var(Vi), Vs>3,Vt>s + 4 

The covariance structure between the X^ and X^ terms is given by the following relations 
Cov(xf)^X(^^)/) = 2(3Var(V'3) +2Var(V2) +8Var(yi)), Vt>4,Vs>5 

Cov(xf'^X,^^'/) = Var(5it) + 6Var(V3) + 4Var(l/2) + 16Var(V'i), Vt > 4 
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cov(xf)^x(^3') 



cov(xf)^xf)^) 



Cov(xf)^x(!>;) 



= Var(S'2t) + 2Var(5'it 
+8E(V2)E(Vi) +4E 

= Var(53t) + 2Var(5'it 
-4E(Vl)^ Vt>4 

= 2Var(S3t) +Var(5'2t 
+12Var(Vi) + 4E(l/s 
+4E(V2)E(Fi) -4E 

= 2Var(S'3t) +Var(S2t 
+ 12Var(l/i) + 4E(\/3 
+4E(l/2)E(Vi) -4E 

= Var(S'3t) + 2Var(Sit 
-4E(Vl)^ Vt>6 

= Var(52t) + 2Var(Sit 
+8E(l/2)E(\/i) +4E 



+ 6Var(y3) + 4Var(V2) + 20Var(T/i; 
Vl)^ > 4 



+ 6Var(T/3) + 4Var(V2) + 12Var(V^i) 



+ 3Var(S'it) + 10Var(l/3) + 4Var(l/2) 
' + 8E(\/3)E(y2) + 8E(V3)E(Vi) 



Vt > 4 



+ 3Var(Sii) + lQW&T(Vi) + 4Var(l/2) 
" + 8E(V'3)E(V2) + 8E(V3)E(l/i) 



> 5 



+ 6Var(V3) + 4Var(V2) + 12Var(yi) 



+ 6Var(V3) + 4Var(V2) + 20Var(Vi; 

Vl)^ > 7 



Var(5'it) + 6Var(V3) + 4Var(\/2) + 16Var(Vi), > 8 
Cov(Xf Xj'!'/) = 2(3VarCl/3) + 2Var(l^2) + 8Var(l/i)), Vs > 4, Vt > s + 5 



(65) 
(66) 

(67) 

(68) 

(69) 

(70) 
(71) 
(72) 



Proof 

All results were first derived using a simple program for the REDUCE computer algebra system. The 
output was used for further computations, and also passed through a filter which type-set the results accu- 
rately for I^TgX. All calculations and computations were verified by re-coding the entire problem in a very 
different way for the MuPAD computer algebra system. The author would be willing to e-mail the REDUCE 
and/or MuPAD programs to any interested parties. □ 



Note that the "far-away" covariances, (jS^), (g9D, (|5D, (|6D, (^, (|5^), (|63), (|6^) and ([Z^) may be deduced 
directly using Lemma |^ and the n-step exchangeability representation theorem. Unfortunately, the other 
covariances are not so amenable to such an approach. 
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